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Abstract 

In this paper, we introduce a new class of nonnegative tensors — strictly nonneg- 
ative tensors. A weakly irreducible nonnegative tensor is a strictly nonnegative tensor 
but not vice versa. We show that the spectral radius of a strictly nonnegative ten- 
sor is always positive. We give some sufficient and necessary conditions for the six 
well-conditional classes of nonnegative tensors, introduced in the literature, and a full 
relationship picture about strictly nonnegative tensors with these six classes of non- 
negative tensors. We then establish global R-linear convergence of a power method for 
finding the spectral radius of a nonnegative tensor under the condition of weak irre- 
ducibility. We show that for a nonnegative tensor T, there always exists a partition of 
the index set such that every tensor induced by the partition is weakly irreducible; and 
the spectral radius of T can be obtained from those spectral radii of the induced ten- 
sors. In this way, we develop a convergent algorithm for finding the spectral radius of 
a general nonnegative tensor without any additional assumption. The preliminary nu- 
merical results demonstrate the feasibility and effectiveness of the proposed algorithm. 
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1 Introduction 



Recently, the research topic on eigenvalues of nonnegative tensors attracted much atten- 
tion pHl|[7tl5|[T m[T2HH] ■ Researchers studied the Perron- Frobenius theorem for nonnegative 
tensors and algorithms for finding the largest eigenvalue, i.e., the spectral radius, of a non- 
negative tensor. Six well- conditional classes of nonnegative tensors have been introduced: 
irreducible nonnegative tensors [2j, essentially positive tensors [lOj, primitive tensors |3], 
weakly positive tensors [H], weakly irreducible nonnegative tensors |1] and weakly primitive 
tensors [1] . Zhang, Qi and Xu [H] concluded the relationships among the first four classes of 
nonnegative tensors. Friedland, Gaubert and Han [3] introduced weakly irreducible nonneg- 
ative tensors and weakly primitive tensors. These two classes, as their names suggest, are 
broader than the classes of irreducible nonnegative tensors and primitive tensors respectively. 

In the next section, we propose a new class of nonnegative tensors, we call them strictly 
nonnegative tensors. We show that the class of strictly nonnegative tensors strictly contains 
the class of weakly irreducible nonnegative tensors mentioned above. We also prove that the 
spectral radius of a strictly nonnegative tensor is always positive. This further strengthens 
the Perron- Frobenius results for nonnegative tensors in the literature [2H11[I2]- 

In Section 3, we give sufficient and necessary conditions for the six well-conditional classes 
of nonnegative tensors, introduced in the literature, and a full relationship picture about 
strictly nonnegative tensors with these six classes of nonnegative tensors. 

Friedland, Gaubert and Han |1] proposed a power method for finding the largest eigen- 
value of a weakly irreducible nonnegative tensor, and established its R-linear convergence 
under the condition of weak primitivity. In Section 4, we modify that method and establish 
its global R-linear convergence for weakly irreducible nonnegative tensors. 

Then, in Section 5, we show that for a nonnegative tensor T, always there exists a 
partition of the index set {1, . . . , n} such that every tensor induced by the partition is weakly 
irreducible; and the largest eigenvalue of T can be obtained from those largest eigenvalues 
of the induced tensors. In Section 6, based on the power method for weakly irreducible 
nonnegative tensors proposed in Section 4, we develop a convergent algorithm for finding 
the spectral radius of a general nonnegative tensor without any additional assumption. We 
report some preliminary numerical results of the proposed method for general nonnegative 
tensors. These numerical results demonstrate the feasibility and effectiveness of the proposed 
algorithm. Conclusions and remarks are given in Section 7. 

Here is some notation in this paper. A tensor T in real field 3? of order m and dimension 
n with m, n > 2 is an m-way array which can be denoted by (Tj^ j^) with Ti-^..,im ^ ^ fo^' 
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all ij G {1, . . . ,n} and j G {1, . . . , m}. For a tensor T of order m > 2 and dimension n > 2, 
if there exist A G C and s G C" \ {0} such that 

n 

{Tx^-%:= J2 Tu,..,^x,,---x,^ = \xT-\ V^G{l,...,n} (1) 

holds, then A is called an eigenvalue of T, x is called a corresponding eigenvector of T with 
respect to A, and (A, x) is called an eigenpair of T. This definition was introduced by Qi [TT] 
when m is even and T is symmetric (i.e., Tj^^^^j^ = Ti^^^^i^ among all the permutations 
of {ii, . . . Independently, Lim [6] gave such a definition but restricted 

X to be a real vector and A to be a real number. Let 3?" := {x G 3?" | x > 0} and 
:= {x G 3f?" I X > 0}. Suppose that T is a nonnegative tensor, i.e., that all of its 
entries are nonnegative. It can be seen that if we define function Ft '■ 3?" — )■ 3?+ associated 
nonnegative tensor T as 

XI ^n2...im^i2---a;i„ I (2) 

i2v:«m = l / 

for alH G {1, . . . , n} and x G 3?" , then ([T]) is strongly related to the eigenvalue problem for 
the nonlinear map Ft discussed in |9j. Denote by p(T) := max{|A| | A G o"(T)} where cr(T) 
is the set of all eigenvalues of T. We call p{T) and cr(T) the spectral radius and spectra of 
the tensor T, respectively. Hence, the eigenvalue problem considered in this paper can be 
stated as: for a general nonnegative tensor T, how to find out p{T)l 

2 Strictly nonnegative tensors 

In this section, we propose and analyze a new class of nonnegative tensors, namely strictly 
nonnegative tensors. To this end, we first recall several concepts related to nonnegative 
tensors in the literature P4^[T0|[T^. 

Definition 2.1 Suppose that T is a nonnegative tensor of order m and dimension n. 

• T is called reducible if there exists a nonempty proper index subset J C {1, . . . , n} such 
that 

Tm2...^„=0, V^iG/, V22,...,«m ^ /. (3) 
IfT is not reducible, then T is called irreducible. 

• T is called essentially positive if Tx"^~^ G 3ft" ^ for any nonzero x G 3ft" . 
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• T is called primitive if for some positive integer k, F^{x) G 3?!|:_|_ for any nonzero 
X e here := Ft{F^'^). 

• A nonnegative matrix M{T) is called the majorization associated to nonnegative tensor 
T, if the {i,j)-th element of M{T) is defined to be Tij, ^j for any i,j G {1, . . . ,n}. T 
is called weakly positive if [M(T)]-j > for all i j ■ 

In Definition I2.H the concepts of reducihility and irreducihility were proposed by Cliang, 
Pearson and Zliang [2l Definition 2.1] (an equivalent definition can be found in Lim (Gj Page 
131]); the concept of essential positivity was given in pil| Definition 3.1]; and the concept of 
primitivity was given in [31 Definition 2.6] while we used its equivalent definition |31 Thoerem 
2.7]. In addition, the concept of majorization was given in [21 Definition 3.5] and earned this 
name in [TOj Definition 2.1]; and the concept of weak positivity was given in |14[ Definition 
3.1]. 

Friedland, Gaubert and Han j4j defined weakly irreducible polynomial maps and weakly 
primitive polynomial maps by using the strong connectivity of a graph associated with 
a polynomial map. Their concepts for homogeneous polynomials gave the corresponding 
classes of nonnegative tensors. 

Definition 2.2 Suppose that T is a nonnegative tensor of order m and dimension n. 

• We call a nonnegative matrix G{T) the representation associated to the nonnegative 
tensor T, if the {i,j)-th element of G{T) is defined to he the summation ofTn^ i^ with 
indices {12, ■ ■ ■ , im} 9 j ■ 

• We call the tensor T weakly reducible if its representation G{T) is a reducible matrix, 
and weakly primitive if G{T) is a primitive matrix. IfT is not weakly reducible, then 
it is called weakly irreducible. 

Now, we introduce strictly nonnegative tensors. 

Definition 2.3 Suppose that T is a nonnegative tensor of order m and dimension n. Then, 
it is called strictly nonnegative if Ft{x) > for any a; > 0. 

Lemma 2.1 An m-th order n dimensional nonnegative tensor T is strictly nonnegative if 
and only if the vector R(T) with its i-th element being j^=i ^n2---jm ^■^ positive. 
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Proof. By Definition EJl Te"""^ > with e beine; the vector of all ones. So, 

n 

i2,---,im = l 

for alH G {1, . . . , n}. The "only if " part follows. 

Now, suppose R(T) > 0. Then, for every i G {1, . . . , n}, we could find j2i, • • • , jm^ such 
that Tij^^...j^_ > 0. So, for any x > 0, we have 

n 

j2,.--,im = l 

for all z G {1, . . . , n}. Hence, the "if part follows. The proof is complete. □ 

Corollary 2.1 An m-th order n dimensional nonnegative tensor T is strictly nonnegative 
if it is weakly irreducible. 

Proof. Suppose that T is weakly irreducible. Note that the signs of vectors G{T)e and 
R{T) are the same, and also that G{T)e is positive since T is weakly irreducible. Because, 
otherwise, we would have a zero row of matrix G{T), which further implies that G{T) is 
reducible, a contradiction. So, by Lemma [2. T is strictly nonnegative. □ 

A result similar to this corollary was given in (3.2) of [1]. On the other hand, the converse 
of Corollary 12.11 is not true in general. 

Example 2.1 Let third order two dimensional nonnegative tensor T be defined as: 
Ti22 = T222 = 1, andTijk = for other i,j, k G {1, 2}, 

then R(T) = i \ > 0. So T is strictly nonnegative by Lemma \2.1\ While, G(T) = 




is a reducible nonnegative matrix, so T is weakly reducible. 



Proposition 2.1 Anm-th order n dimensional nonnegative tensorT is strictly nonnegative 
if and only if Ft is strictly increasing 13], i.e., Ft{x) > Friy) for any x > y > 0. 



Proof. If T is strictly increasing, then, for any x > 0, we have Tx™ ^ > TO*" ^ = 0. So, T 
is strictly nonnegative. The "if part follows. 
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Now, suppose that T is strictly nonnegative. Then, R{T) > by Lemma 12.11 So, for 
every z G {1, . . . ,n}, we could find j2i, • • • ,jmi such that Tij^ ...j^^ > 0. If < x < y, then 
^h, ■ ■ ■ ^jm^ < Vh, ■ ■ ■ Vjm^ for any i G {1, . . . , n}. Hence, 

n 

j2vjm = l 
> 

for any i E {1, . . . ,n}. So, the "only if part follows. The proof is complete. □ 

We now show that the spectral radius of a strictly nonnegative tensor is always positive. 
At first, we present some notation. For any nonnegative tensor T of order m and dimension 
n and a nonempty subset J of {1, . . . , n}, the induced tensor denoted by Tj of I is defined 
as the m-th order |J| dimensional tensor {Tj^ | G /}. Here |/| denotes the 

cardinality of the set /. 

Lemma 2.2 For any m-th order n dimensional nonnegative tensor T and nonempty subset 
/C{l,...,n}, p{T)>p{Tj) 

Proof. Let i^' be a nonnegative tensor of the same size of T with Kj = Tj and zero anywhere 
else. Then, obviously, T > > in the sense of componentwise and p{K) = p{Tj). Now, 
by [111 Lemma 3.4], p{K) < p{T). So, the result follows immediately. □ 

Theorem 2.1 If nonnegative tensor T is strictly nonnegative, then p{T) > 0. 

Proof. By Lemma EH R{T) > 0, so G{T)e > 0. Now, 

(I) if G{T) is an irreducible matrix (i.e., T is a weakly irreducible tensor by Definition 12. 21) . 
then p{T) is positive. Actually, we could find x > such that Tx"^^^ = p(T)x^"^^^^ by 
Perron- Frobenius Theorem [1], so the strict positivity of T implies p(T) > 0. 

(II) if G{T) is a reducible matrix (i.e., T is a weakly reducible tensor by Definition 12. 2p . we 
could find a nonempty / C {1, . . . , n} such that [G{T)]-j = for alH G / and j ^ /. 
Denote by K the principal submatrix of G{T) indexed by /, and T' the tensor induced 
by /. Since G{T)e > and [G{T)].. = for alH G / and j ^ I, we still have Ke > 0. 
Hence, T' is also strictly nonnegative since G{T') = K and Ke > 0. By Lemma [2.21 
we have that p{T) > p{T'). 
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So, inductively, we could finally get a tensor sequence T,T', . . . , T* (since n is finite) 
with 

p{T)>p{T')>--->p{T*), 

and T* is a weakly irreducible tensor when the dimension of T* is higher than 1, or T* is 
a positive one dimensional tensor (i.e., a scalar) since T* is strictly positive. In both cases, 
p(T*) > by (I). The proof is complete. □ 

Example 2.2 Let third order 2 dimensional nonnegative tensor T he defined as: 

7i22 = 1, andTijk = for other i,j,k G {1,2}. 
The eigenvalue equation of tensor T becomes 

= Xxl 

Obviously, p{T) = 0. Hence, a nonzero nonnegative tensor may have zero spectral radius. 
So, Theorem \2.1\ is not vacuous in general. 

At the end of this section, we summarize the Perron-Frobenius Theorem for nonnegative 
tensors as follows. 

Theorem 2.2 Let T be an m-th order n dimensional nonnegative tensor, then 

• (Yang and Yang JTBJ) p{T) is an eigenvalue ofT with a nonnegative eigenvector; 

• (Theorem \2.1\) if furthermore T is strictly nonnegative, then p{T) > 0; 

• (Friedland, Gaubert and Han [40 if furthermore T is weakly irreducible, then p{T) has 
a positive eigenvector; 

• ( Chang, Pearson and Zhang f^) if furthermore T is irreducible and ifX is an eigenvalue 
with a nonnegative eigenvector, then A = p(T); 

• (Yang and Yang JTB]) ifT is irreducible, and T has k distinct eigenvalues of modulus 
p{T), then the eigenvalues are p{T) exp{i2TTj/k) with = —1 and j = 0, . . . , k — 1; 

• (Chang, Pearson and Zhang ^3]) if furthermore T is primitive, then k = 1; and 

• (Pearson flW) ifT is further essentially positive, p{T) is real geometrically simple. 
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3 Relationships of the seven classes of nonnegative 
tensors 



In this section, we make a clear diagram of the relationships among the concepts of non- 
negative tensors mentioned above. Let T be a nonnegative tensor of order m and dimension 
n throughout this section. Let E be the identity tensor of order m and dimension n with its 
diagonal elements as 1 and off-diagonal elements as (when m = 2, E is the usual identity 
matrix) . 

The relationships among irreducibility, primitivity, weak positivity and essential positiv- 
ity were characterized in Section 3], which can be summarized as follows: 

• If T is essentially positive, then T is both weakly positive and primitive. But the 
converse is not true. Moreover, there exists a tensor which is weakly positive and 
primitive simultaneously, but not essentially positive. 

• There is no inclusion relation between the class of weakly positive tensors and the class 
of primitive tensors. 

• If T is weakly positive or primitive, then T is irreducible. But the converse is not true. 

Actually, there are close relationships between (weakly) irreducibility and (weakly) prim- 
itivity, and between weak positivity and essential positivity. 

Theorem 3.1 nonnegative tensor T is weakly irreducible / irreducible / weakly positive 
if and only if T + E is weakly primitive / primitive / essentially positive. A nonnegative 
tensor T is essentially positive if and only if it is weakly positive, and all of its diagonal 
elements are positive. 

Proof. 

• (Weakly irreducible / Weakly primitive) We have that nonnegative representation 
matrix G{T) is irreducible if and only if matrix G{T + E) is primitive [H Theorem 
2.1.3 and Corollary 2.4.8]. So, by Definition 12. 2[ tensor T is weakly irreducible if and 
only if tensor T + E is weakly primitive. 

• (Weakly positive / Essentially positive) The claims follow directly from Definition 12.11 
and the nonnegativity of T. 
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• (Irreducible / Primitive) First, it follows from [T2| Theorem 6.6] immediately that T 
is irreducible if and only if -F^^^(x) > for any nonzero x G 3?" . 

Second, if T + E is primitive, then T+E is irreducible. We can prove that E^-^x) > 
for any nonzero x G 3?", which implies that T is irreducible by the above result. 
Actually, let K := T + ^E, then, 2K is irreducible and nonnegative. We have 2(T + 
E) = 2{K + \E) = 2K + E and F:^-\^^{x) = F^j^l^ix) > for any nonzero x e 
by the above result. It is straightforward to check that F^(j'+E)i^) ~ 2'^^ E^~]^{x) for 
any nonzero x G . So, the result follows. □ 

We now discuss some other relations among these six classes of nonnegative tensors. By 
Definitions 12.11 and 12.21 if T is irreducible, then it is weakly irreducible. Nevertheless, the 
converse is not true in general, which can be seen from the following example. 



Example 3.1 Let T be a third order three dimensional tensor which is defined by T123 
^312 = ^"332 = 1 and Tijk = for other i,j,k G {1,2,3}. Then, G{T) 



is irreducible but T2ij = for all i,j G {1, 3}, which says that T is reducible. 



T221 




^223 
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1 \ 
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2 


1 


V 1 


2 


1 / 



By Definition 12. 2[ if T is weakly primitive, then T is weakly irreducible. The following 
example demonstrates that the converse is not true. 



Example 3.2 Let T be a third order three dimensional tensor which is defined by T122 = 
^233 = ^311 = 1 (iiT'd Tijk = for other i,j,k G {1,2,3}. Then, T is not weakly primitive, 

/ 1 \ 

since its representation matrix G{T) = 1 is not primitive. But it is an irreducible 

\i 0; 

matrix, and hence, T is weakly irreducible by Definition \2.2[ 



We now discuss the relations between primitivity and weak primitivity. The following 
result is a complementary to that in Chang, Pearson and Zhang [3j. 

Lemma 3.1 For a nonnegative tensor T of order m and dimension n, if M{T) is primitive, 
then T is primitive, and if T is primitive, then G{T) is primitive. 

Proof. If M(T) is primitive, then let K := [M{T)f with k:=n'^-2n + 2, we have Kij > 
for any i, j G {1, . . . , n} [H Theorem 2.4.14]. Now, for any nonzero x G 3?" , suppose Xj > 0. 
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Then, for any z G {1, . . . , n}, there exist 12, . . . ,ik such that M{T)ii^^ M{T)i^i^, . . . , M{T)i^j > 
0. So, Tii2,,,i2, ■ ■ ■ iTi^,j,,,j > 0. Thus, we have . > for any i G {1, • • • ,n}. As the 

above inequahties hold for any nonzero x G we obtain that T is primitive. 

If T is primitive, then for some integer k > 0, F^{x) > for any nonzero x G 
For any i G {l,...,n}, let denote the j-th column of the n x n identity matrix for 
any j G We thus have [Fy(ej)]^ > 0. So, we must have indices {i^, . . . , i"^} , 



By Lemma 13.11 and Definition 12. 2^ if T is primitive, then T is weakly primitive. 
We list some further relationships among the concepts mentioned above as follows: 

• By Example 13. Ij we see that G{T) is primitive but T is reducible since T2ij = for all 
i,j G {1,3}. Hence, there exists a nonnegative tensor which is weakly primitive but 
not irreducible. 

• Let T be a third order two dimensional tensor which is defined by T122 = T211 = 1 and 
Tijk = for other i,j,k G {1,2}. Then, T is weakly positive, and hence, irreducible, 
but not weakly primitive. 

• Let T be a third order two dimensional tensor which is defined by T122 = ^211 = 
T212 = T121 = 1 and Tijk = for other k G {1, 2}. Then, T is weakly positive but 
not primitive, since Tef = 62 and Te^ = ei. However, it is weakly primitive, since 



Using Corollary 12.11 and Example 12. H we can summarize the relationships obtained so 
far in Figure 1. 

4 Global R-linear convergence of a power method for 
weakly irreducible nonnegative tensors 

We present here a modification of the power method proposed in ]3]. 
Algorithm 4.1 (A Higher Order Power Method (HOPM)) 




Lij > for all i,j G {1, . . . , n}. Hence, G{T) is primitive. □ 
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Strictly Nonnegative 




Figure 1: Relationsliips of tlie seven classes of nonnegative tensors 

Step Initialization: choose x^"-* E ^++- -^^^ k := 0. 
Step 1 Compute 



X 



maxi<j<. 



(t(x('=))'"-i). 



and (5 := mini 



<i<n 



(t(x('=))'"-i). 



step 2 //a (x^'^+i)) = /3 (a;(''+^)), sto;?. Otherwise, letk:=k + l, go to Step 1. 



Algorithm 14.11 is well-defined if the underlying tensor T is a strictly nonnegative tensor, 
as in this case, Tx™~^ > for any x > 0. Hence, Algorithm 14. II is also well-defined for weakly 
irreducible nonnegative tensors. The following theorem establishes convergence of Algorithm 
14.11 if the underlying tensor T is weakly primitive, where we need to use the concept of 
Hilbert's projective metric [9j. We first recall such a concept. For any x,y E 9ft" \ {0}, if 
there are a,/3 > such that ax < y < (3x, then x and y are called comparable. If x and y 
are comparable, and define 



miy/x) := sup{a > \ ax < y} and M{y/x) := inf{/3 > \ y < (3x}, 



11 



then, the Hilbert's projective metric d can be defined by 

^(^2; ._ I ^Qg( mS/x) )' if ^ ^^"i ^ comparable, 
1 +00, otherwise 

for x,y e^l\ {0}. Note that if x,y e A„ := {z e 3?^+ | e'^z = 1}, then d{x, = if and 
only if X = Actually, it is easy to check that d is a. metric on A„. 

Theorem 4.1 Suppose that T is a weakly irreducible nonnegative tensor of order m and 
dimension n. Then, the following results hold. 

(i) T has a positive eigenpair (A,x), and x is unique up to a multiplicative constant, 
(a) Let (A*,a;*) he the unique positive eigenpair ofT with Yl^=ii.^*)i = 1- Then, 

mm max — - = A* = max mm — -. 

xgSR!^^ l<j<n xeSR^+ l<i<n 

(Hi) If {v,v) is another eigenpair ofT, then \v\ < A*. 

(iv) Suppose that T is weakly primitive and the sequence {x^''^ is generated by Algorithm 
Jl\ Then, {x^''^} converges to the unique vector x* G 3f?"_|_ satisfying T{x*)"^ = 



A*(x*)t'" ^'^ and Yl'i=i^i — '^^^ there exist constant 6 G (0,1) and positive integer 
M such that 

d{x^'^\x*)<9^^^^i-^ (4) 

u 

holds for all k > 1. 



Proof. Except the result in @, all other results in this theorem can be easily obtained 
from [H Theorem 4.1, Corollaries 4.2, 4.3 and 5.1]. So, we only give the proof of (jl]) here. 
We have the following observations first: 

• 3?" is a normal cone in Banach space S?", since y > x > implies \\y\\ > \\x\\; 

• 3?" has nonempty interior 3^"+ which is an open cone, and Ft : 3?"^ — t- 3?"^ is 
continuous and order-preserving by Corollary 12.11 and the nonnegativity of tensor T; 

• Ft is homogeneous of degree 1 in 3ft" ^; 

• the set A„ is connected and T has an eigenvector x* in A„ by Theorem 14.11 (i); 

• by ([2]), Ft is continuously differentiable in an open neighborhood of x*, since x* > 0; 
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by Definition 1221 G(T) is primitive, hence there exists an integer such that [G{T)]^ > 



0. So, [G(T)]'^ X is comparable with x* for any nonzero x G 3fJ![:; 

• G(T) : 3?" — )• 3ft" is a compact linear map, hence its essential spectrum radius is 
zero [9l Page 38], while its spectral radius is positive since it is a primitive matrix [1]. 

Hence, by [HI Corollary 2.5 and Theorem 2.7], we have that there exist a constant 6 G (0, 1) 
and a positive integer M such that 

d{x^^^\x*) <e^d{x^''\x*), (5) 

where d denotes the Hilbert's projective metric on 9ft" \ {0}. 
By O Proposition 1.5], we also have that 

d{FT{x),FT{y))<d{x,y) (6) 

for any x,y E 9ft". Since A* > 0, by the property of Hilbert's projective metric d [9l Page 
13] we have that 

d(x^^-^^ X*) = d (Jl^ A=d( -^FAx*) 

= d{FT{x^^^),FT{x*)) < d{x^^\x*) 

holds for any k. So, for any k > M, we could find the largest j such that k > Mj and 
M{j + l)>k. Hence, 

d{x^''\x*) < d{x^^'^\x*) < eH{x^''\x*) < eTi-^d{x^''\x*) 

which implies (jl]) for all k > M. When 1 < < M, we have 9m^ > 9, since 9 G (0,1). 
Therefore, (jl]) is true for all > 1. □ 

We denote by x^P^ a vector with its i-th element being x^. 

By Theorems 13.11 and 14.11 the following result holds obviously. 

Theorem 4.2 Suppose that T is a weakly irreducible nonnegative tensor of order m and 
dimension n, and the sequence {x^''^} is generated by Algorithm 4jl with T being replaced 



by T + E. Then, {x^''^ converges to the unique vector x* G 9ft" _,_ satisfying T(x*)"* ^ = 
K{x*y"^"^^ and J2^=i = 1; ^'^^ there exist a constant 9 G (0, 1) and a positive integer M 
such that (jl]) holds for all k > 1. 
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Remark 4.1 (i) Compared with Corollaries 5.1 and 5.2], a main advantage of our results 
is that (j4]) in Theorem \4.1^ iv) gives the global R-linear convergence of Algorithm \4.1\ while 



the geometric convergence given in Corollary 5.2] is essentially a result o/ local R-linear 
convergence, (ii) Compared with the results in fl^ , a main advantage of our results is that 
the problem we considered in Theorem \4.2\ is broader than that in JT^ , i.e., our results are 



obtained for the weakly irreducible nonnegative tensors; while the results in [T4^ hold for the 



irreducible nonnegative tensors. There are also other differences between Theorem \4.2\ and 
those in [14^ , such as. Theorem 4-2 gives the global R-linear convergence of the iterated 
sequence {x*^^^} of Algorithm \4.1\ for weakly irreducible nonnegative tenors; while the Q- 
linear convergence of the corresponding eigenvalue sequence was proved in [14^ for weakly 
positive nonnegative tensors. 

Theorem 14.21 is an important basis for us to develop a method for finding the spectral 
radius of a general nonnegative tensor. 



5 Partition a general nonnegative tensor to weakly ir- 
reducible nonnegative tensors 

If a nonnegative tensor T of order m and dimension n is weakly irreducible, then from 
Theorem \A.2\ we can find the spectral radius and the corresponding positive eigenvector of 
T by using Algorithm 14.11 A natural question is that, if T is not weakly irreducible, what 
can we do for itl 

In this section, we show that if a nonnegative tensor T is not weakly irreducible, then 
there exists a partition of the index set {1, . . . , ra} such that every tensor induced by the set 
in the partition is weakly irreducible; and the largest eigenvalue of T can be obtained from 
these induced tensors. Thus, we can find the spectral radius of a general nonnegative tensor 
by using Algorithm 14.11 for these induced weakly irreducible tensors. At the end of this 
section, we show that, if weakly irreducibility is replaced by irreducibility, a similar method 
does not work. 

The following result is the theoretical basis of our method. 

Theorem 5.1 JJ^, Theorem 2.3] For any nonnegative tensor T of order m and dimension 
n, p{T) is an eigenvalue with a nonnegative eigenvector x G 3?" corresponding to it. 

To develop an algorithm for general nonnegative tensors, we prove the following theo- 
rem which is an extension of the corresponding result for nonnegative matrices [1]. For the 
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convenience of the sequel analysis, a one dimensional tensor is always considered as irre- 
ducible, hence weakly irreducible. Similarly, one dimensional positive tensors are considered 
as primitive. Note that Algorithm 14.11 works for one dimensional primitive tensor as well. 
Nonetheless, weakly irreducible nonnegative tensors with dimension one may have zero spec- 
tral radius, but they are always positive when the dimension n > 2 by Theorem 12.11 Note 
that, n is assumed to be no smaller than two throughout this paper, while the case of one 
dimensional tensors is needed in the presentation of partition results in this section. 

Theorem 5.2 Suppose that T is a nonnegative tensor of order m and dimension n. IfT is 
weakly reducible, then there is a partition {/i, . . . , J^} of {1, ... ,n} such that every tensor 
in {Tj. \ j E {1, . . . , k}} is weakly irreducible. 

Proof. Since T is weakly reducible, by Definition 12.21 we can obtain that the matrix G{T) 
is reducible. Thus, we could find a partition { Ji, . . . , Ji} of {1, ... , n} such that 

(*) every matrix (a second order tensor) in | i G {1, . . . ,/}} is irreducible and 

[G(T)]^_i_ = for any s E Jp and t E Jq such that p > q. 

Actually, by the definition of reducibility of a matrix, we can find a partition { Ji, J2} of 
{l,...,n} such that [G{T)]^^ = for any s G J2 and t G Ji. If both [G{T)]j_^ and [G{T)]j^ are 
irreducible, then we are done. Otherwise, we can repeat the above analysis to any reducible 
block(s) obtained above. In this way, since {1, . . . ,n} is a finite set, we can arrive at the 
desired result {-k). 

Now, if every tensor in {Tj- \ i G {1, . . . ,/}} is weakly irreducible, then we are done. 
Otherwise, we repeat the above procedure to generate a partition of T to these induced 
tensors which are not weakly irreducible. Since {1, . . . ,n} is finite, this process will stop in 
finite steps. Hence, the theorem follows. □ 

By Theorems 15.21 and 13. H we have the following corollary. 

Corollary 5.1 Suppose thatT is a nonnegative tensor of order m and dimension n. IfT is 
weakly irreducible, then T + E is weakly primitive; otherwise, there is a partition {/i, . . . , Ik} 
of {1, . . . ,n} such that every tensor in {(T + E)j^ \ j G {1, . . . , k}} is weakly primitive. 

Given a nonempty subset I of {1, ... ,n} and an n vector x, we will denote by xj an n 
vector with its z-th element being Xj if z G / and zero otherwise; and x{I) a \I\ vector after 
deleting Xj for j ^ I from x. 
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Theorem 5.3 Suppose that T is a weakly reducible nonnegative tensor of order m and 
dimension n, and {/i, . . . , Ik} is the partition of {1, ... , n} determined by Theorem \5.2[ 
Then, p(T) = piTj^) for some p E {1, . . . ,k}. 



Proof. By the proof of Theorem I5.2[ for the nonnegative matrix G{T), we could find a 
partition { Ji, Ji} of {1, ... ,n} such that 

• every matrix in {[GiT)]j, \ i G {!,...,/}} is irreducible and [G(T)]^^ = for any 
s E Jp and t E Jq such that p > q. 

First, we have that p{Tj.) < p{T) for alH G {1, . . . , /} by Lemma [2.21 

Then, denote by {p{T),x) a nonnegative eigenpair of T which is guaranteed by Theorem 
Em Since [G{T)].. = for all i G Ji and j G u[z}^J,. We must have 

Tu2...i^ = V« G Ji, \/{t2, ...,im}^ Ji. (7) 

Hence, for all i E Ju^e have 

p(T)xr' = {Tx^'-\ 

n 

12, ■■■,im = i 

n 

~ ^ ] Tii2...im^i2 ' ' ' ^im 

{«2v,*m}C J; 

= {TjMJi)r'"],. 

where the third equality follows from ([7]). If x{Ji) ^ 0, then {p{T),x{Ji)) is a nonnegative 
eigenpair of tensor Tj^; and if x{Ji) = 0, then we have 

T^,^ (x(u;.-\j,))'"-^ = p(T) [x(u;.-\j,)]t--^i . 

In the later case, repeat the above analysis with T being replaced by T^i-ij . Since x ^ 
and / is finite, we must find some t G {!,...,/} such that x{Jt) ^ and {p{T),x{Jt)) is a 
nonnegative eigenpair of tensor Tj^. 

Now, if Tj^ is weakly irreducible, we are done since Jt = Ip for some p G {1, . . . ,k} by 
the proof of Theorem 15.21 Otherwise, repeat the above analysis with T and x being replaced 
by Tjj and x{Jt), respectively. Such a process is finite, since n is finite. Thus, we always 
obtain a weakly irreducible nonnegative tensor Tj^ with Ip C {1, . . . ,n} for some p such 
that {p(T),x{Ip)) is a nonnegative eigenpair of tensor T/^. Furthermore, {p{T),xs) with 
5* := Uf^^/p is a nonnegative eigenpair of tensor T. 
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The proof is complete. 



□ 



Note that if T is furthermore symmetric, then we could get a diagonal block representa- 
tion of T with diagonal blocks Tj. (after some permutation, if necessary). Now, by Corollary 
15.11 and Theorems 14.21 15.21 and 15. 3[ we could get the following theorem. 



Theorem 5.4 Suppose that T is a nonnegative tensor of order m and dimension n. 

(a) IfT is weakly irreducible, then T + E is weakly primitive by Theorem \3.1\ and hence, 
Algorithm \4.1\ with T being replaced by T + E converges to the unique positive eigenpair 
{p(T + E),x) ofT + E. Moreover, {p(T + E) — l,x) is the unique positive eigenpair 
ofT. 

(b) If T is not weakly irreducible, then, we can get a set of weakly irreducible tensors 
{Tj. I j = l,...,k} with k > 1 by Theorem I5.H For each j G {l,...,k}, we use 
item (a) to find the unique positive eigenpair {p{Tj.),x^) of Tj_. which is guaranteed 
by Corollary 15. il when \Ij\ > 2 or eigenpair (T/^,,1) when \Ij\ = 1. Then, p{T) = 
maxj=i^...^fc p(T/^) by Theorem \5.3[ IfT is furthermore symmetric, then, x withx{Ij*) = 
x^* is a nonnegative eigenvector ofT where j* G argmaxj^^ j^p{Ti.) 



Remark 5.1 By Theorem \5.4\ and Algorithm \4-I\ if nonnegative tensor T is weakly irre- 



ducible, then, the spectral radius of T can be found directly by Algorithm \4-l with T being 



replaced by T + E. If T is not weakly irreducible, then, we have to find the partition of 
{l,...,n} determined by Theorem \5.2i Fortunately, we can find such a partition through 
the corresponding partition of the nonnegative representation matrix of T and its induced 
tensors according to Theorem \5.3[ The specific method of finding such a partition is given 
in the next section. 



Most of the known papers, which established the Perron-Frobenius theorem and showed 
the convergence of the power method for nonnegative tensors, concentrated on the class of 
irreducible nonnegative tensors. A natural question is that, for any given reducible nonneg- 
ative tensor T, whether a partition of T similar to the result given in Theorem \5.2\ can be 
derived or not. If so, whether the spectral radius of T can be obtained by using the power 
method for the induced irreducible nonnegative tensors or not. At the end of this section, 
we answer these two questions. The answer to the first question is positive, which is given 
as follows. 



Theorem 5.5 Suppose that T is a nonnegative tensor of order m and dimension n. IfT 
is reducible, then there is a partition {/i, . . . , Ik} of {1,2,..., n} such that any one of the 
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tensors {Tj- | j e {1, . . . , k}} is irreducible and 

Tst2...t^ =0, Vs e Ip, V{t2, ■■■,tm} C Ig, Vp > q. 

Proof. Since T is reducible, by the definition of reducibility, there exists a nonempty proper 
subset I2 of {1, . . . , n} such that 

Tii^...i^ = 0, Vi G I2, Vis, . . . , 2„ G Ji := {1, . . . , n} \ /2. 

If both T/j and T/j are irreducible, then we are done. Without loss of generality, we assume 
that T/^ is irreducible and Tj^ is reducible. Then, by the reducibility of Tj^, we can get a 
partition {J2, J3} of I2 such that 

Tii2...i™ = 0, Vi G J3, Vi2, ■ ■ ■ ,im ^ J2 ■= h \ Js- 

If both and Tjg are irreducible, then we are done, since {Ji, J2, J3} is the desired partition 
of {1, ... , n}. Otherwise, repeating the above procedure, we can get the desired results, since 
n is finite. □ 

However, the answer to the second question is negative, which can be seen by the following 
example. 

Example 5.1 Let T be a third order two dimensional tensor which is defined by 
Till = Ij T112 = T121 = T211 = 4, T122 = T212 = T221 = 0, andT222 = 1- 

Since T122 = 0, tensor T is reducible. And Tm = T222 = 1 is the largest eigenvalue of both 
induced tensors by Theorem \5.5[ While the nonnegative eigenpairs ofT are 

(1,(0,1)^) and (7.3496,(0.5575,0.4425)^). 

This example prevents us to use p(T/.)s' to get p{T) under the framework of irreducibility. 
In addition, it is easy to see that checking weak irreducibility of tensor T is much easier 
than checking irreducibility of tensor T, since the former is based on a nonnegative matrix 
which has both sophisticated theory and algorithms [1]. 

6 A specific algorithm and numerical experiments 

In this section, based on Algorithm 14. Theorem 14. 2 1 and the theory established in Section 
5, we develop a specific algorithm for finding the spectral radius of a general nonnegative 
tensor. 
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6.1 A specific algorithm 



In this subsection, we give an algorithm for finding irreducible blocks of a nonnegative 
matrix M, which is based on the fact that a nonnegative matrix M is irreducible if and only 
if (M + E)""' >0 [IJ. 

Algorithm 6.1 (Irreducible blocks of nonnegative matrices) 

Step Given a nonnegative matrix M, let k = 1 and := M + E. 
Step 1 Until k = n-l, repeat := C^'^{M + E) and k:=k + l. 

Step 2 Sort the numbers of nonzero elements of columns of C^^^ in ascend order, then 
perform symmetric permutation to C^^^ according to the sorting order into a matrix 
K; sort the numbers of nonzero elements of rows of K in descend order, then perform 
symmetric permutation to K according to the sorting order into a matrix L. Record 
the two sorting orders. 

Step 3 Let i = 1, j = 1 and s = 1, create an index set Ij and an vector ind, put i into Ij 
and index it to be the s-th element in Ij, and set ind{i) to be 1. 

Step 4 If L{d, Ij{s)) > and L{Ij{s),d) > for some d G {1, . . . ,n} with ind{d) being not 
1, where Ij{s) is the s-th element in Ij, set s := s + 1 and put d into Ij and index it 
to be the s-th element in Ij. Set ind{d) to be 1, and i := i + 1. If there is no such d 
or i = n, go to Step 6; if there is no such d but i < n, go to Step 5. 

Step 5 Let j := j + 1 and s := 1. Create index set Ij, and find a d with ind{d) being not 
1, put d into Ij and index it to be the s-th element in Ij. Set ind{d) to be 1, go back 
to Step 4- 

Step 6 Using sorting orders in Step 2 and partition {Ii, . . . , 1^} found by Steps 3-5, we 
could find the partition for the matrix M easily. 

Now, we propose a specific algorithm for finding the spectral radius of a general nonneg- 
ative tensor. 

Algorithm 6.2 (Spectral radius of a nonnegative tensor) 

Step Let v be an n vector with its elements being zeros, and i = 1. 
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Step 1 Given a nonnegative tensor T of order m and dimension n, compute its represen- 
tation matrix G{T) as Definition \2.S[ 

Step 2 Finding out the partition {Ii, . . . , J^} of {1, . . . ,n} using Algorithm \ 6.1\ with M 
being replaced by G{T). 

Step 3 If k = 1, using Algorithm \4.1\ to finding out the spectral radius p ofT, set v{i) = p, 
and i = i + 1. Otherwise, go to Step 4- 

Step 4 For j = 1, . . . ,k, computing the induced tensor Tj^ and its corresponding repre- 
sentation matrix Gj, set T as Tj., G{T) as Gj and n as \Ij\, run subroutine Steps 
2-4. 

Step 5 Out put the spectral radius of T as max^^j^ ^(0- 

6.2 Numerical experiments 

In this subsection, we report some preliminary numerical results for computing the spec- 
tral radius of a general nonnegative tensor using Algorithm 16.21 (with Algorithms 14.11 and 
EH). All experiments are done on a PC with CPU of 3.4 GHz and RAM of 2.0 GB, and all 
codes are written in MATLAB. 

To demonstrate that Algorithm 16.21 works for general nonnegative tensors, we randomly 
generate third order nonnegative tensors with dimension n which is specialized in Table 1. 
We generate the testing tensors by randomly generating their every element uniformly in 
[0, 1] with a density Den which is specialized in Table 1. We use Algorithm 16.21 to find the 
spectral radii of the generated tensors for every case, i.e., with different dimensions n and 
element density Den. The algorithm is terminated if \a{x^^' ) - /3(a;W)| < 10"^ For every 
case, we simulate 50 times to get the average spectral radius p := "(^'' ^ ^j-^g average 

number of iterations Ite performed by Algorithm 14.11 the average weakly irreducible blocks 
of the generated tensors Blks, and the average residual of Tx^ — px'^^ with the found spectral 
radius p and its corresponding eigenvector x in 2-norm Res. We also use Per to denote the 
percentage of weakly irreducible tensors generated among the 50 simulations, and TolCpu 
to denote the total cputime spent for the simulation in every case. All results are listed in 
Table 1. In addition, we also test the following example and the related numerical results 
are listed in Table 2, where BIk denotes the block number of the computation, Ite denotes 
the iteration number, and the other items are clear from Algorithm 16.21 The initial points 
for both tests in Tables 1 and 2 are randomly generated with their every element uniformly 
in (0, 1). All the simulated tensors are strictly nonnegative by the above simulation strategy, 
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since every component of R{T) is the summation of so many terms, it is never zero in our 
simulation. 

Example 6.1 Let third order three dimensional tensor T be defined by Tm = T222 = 1? 
T122 = 3, T211 = 5, T333 = 4 and Tijk = for other i, j, k G {1,2,3}. Then, the eigenvalue 
problem reduces to: 

It is easy to see that tensor T is not weakly irreducible and the nonnegative eigenpairs ofT 
are 

(4,(0,0,1)^) and (4.8730,(0.4365,0.5635,0)^). 

Hence, we get the spectral radius of T is 4.8730 which agrees the numerical results in Table 
2. 

From Tables 1 and 2, we have some prehminary observations: 

• Algorithm 16.21 can find the spectral radius of a general nonnegative tensor efficiently. 

• As expected, the more dense of nonzero elements of the underlying tensor, the higher 
the probability of it being weakly irreducible. We note that function sprand which is 
used in our test in MATLAB does not return a full-dense matrix even with the density 
parameter being 1, so the percentage Per for n = 3 is not close enough to 100 even 
when Den = 0.9. 

• From Definition 12.21 we note that elements of G{T) are the summation of so many 
elements of T. So, it is possible that G{T) is an irreducible matrix even when T is a 
very sparse tensor. This can be noticed from the last several rows in Table 1. 

7 Conclusions and remarks 

In this paper, we proposed a new class of nonnegative tensors — strictly nonnegative 
tensors, and proved that the spectral radii for strictly nonnegative tensors are always posi- 
tive. We discussed the relationships among the seven well- conditional classes of nonnegative 
tensors, and showed that the class of strictly nonnegative tensors strictly contains the other 
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six classes of nonnegative tensors. We showed that a modification of the power method in [1] 
for finding the spectral radius of a nonnegative tensor is globally R-linearly convergent for 
weakly irreducible nonnegative tensors. Based on the convergent power method for weakly 
irreducible nonnegative tensors, we proposed an algorithm for finding the spectral radius of 
a general nonnegative tensor. The preliminary numerical results addressed the effectiveness 
of the method. 

Some issues deserve to be further investigated, such as, how to investigate the related 
topics for some classes of tensors beyond nonnegative tensors, and how to find the smallest 
eigenvalue of these classes of tensors? 

Acknowledgement. We are grateful to Professor Qin Ni for inspiring Theorem 12.11 
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Table 1: Numerical results 



n 


Den 


p Per Ite Blks Res 


TolCpu 


3 


0.10 


0.118 0.00 6.88 2.88 2.0516e-008 


0.30 


3 


0.20 


0.409 14.00 17.88 2.52 1.3521e-007 


0.38 


3 


0.30 


0.671 36.00 25.32 2.06 6.2038e-008 


0.44 


3 


0.40 


0.787 44.00 27.6 1.9 1.4773c-006 


0.41 


3 


0.50 


1.113 66.00 31.06 1.38 8.1021e-008 


0.42 


3 


0.60 


1.032 72.00 33.76 1.44 9.8837e-008 


0.44 


3 


0.70 


1.196 78.00 31.4 1.34 8.6830e-008 


0.47 


3 


0.80 


1.244 80.00 37.82 1.28 7.3281e-007 


0.50 


3 


0.90 


1.528 86.00 33.26 1.22 2.1994e-006 


0.44 


4 


0.10 


0.368 14.00 19.56 3.26 3.5644e-008 


0.47 


4 


0.20 


0.554 24.00 27.04 2.74 7.1762e-008 


0.48 


4 


0.40 


1.060 62.00 42.28 1.64 1.6366e-006 


0.50 


4 


0.80 


1.945 90.00 35.76 1.1 6.5548e-008 


0.47 


10 


0.05 


0.466 14.00 51.6 5.72 1.8168e-006 


0.94 


10 


0.10 


1.214 56.00 49.44 2.34 5.5063e-007 


1.05 


10 


0.15 


2.363 78.00 40.96 1.26 1.5255e-008 


0.98 


10 


0.20 


3.124 88.00 31.44 1.2 1.2771e-008 


0.95 


20 


0.05 


2.537 56.00 39.51 2.08 1.8818e-009 


3.58 


20 


0.10 


5.606 86.00 31.34 1.14 4.7892e-009 


3.28 


30 


0.05 


6.103 80.00 31.84 1.28 2.9270e-009 


9.42 


30 


0.10 


12.173 84.00 27.06 1.16 2.6974e-009 


8.02 


40 


0.05 


10.698 82.00 28.18 1.26 1.8279e-009 


18.02 


50 


0.05 


16.710 91.00 27.2 1.06 1.3807e-009 


36.80 
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Table 2: Numerical results for Example 16.11 



Blk 


Ite 
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1 zLiAp-unnn 


1 
1 


9 


o.zuu 


A 

Hl.D I i 


fi 98fie. nni 
u.zoue-uui 


1 1 "^Ap nni 


A. 




4 Q74 


4 774 


2 002e-001 


3 573e-002 


1 


4 


4.905 


4.841 


6.383e-002 


1.143e-002 


1 


5 


4.883 


4.863 


2.035e-002 


3.641e-003 


1 


6 


4.876 


4.870 


6.491e-003 


1.162e-003 


1 


7 


4.874 


4.872 


2.070e-003 


3.704e-004 


1 


8 


4.873 


4.873 


6.602e-004 


1.181e-004 


1 


9 


4.873 


4.873 


2.106e-004 


3.767e-005 


1 


10 


4.873 


4.873 


6.715e-005 


1.201e-005 


1 


11 


4.873 


4.873 


2.141e-005 


3.832e-006 


1 


12 


4.873 


4.873 


6.830e-006 


1.222e-006 


1 


13 


4.873 


4.873 


2.178e-006 


3.897e-007 


1 


14 


4.873 


4.873 


6.946e-007 


1.243e-007 


2 


1 


4.000 


4.000 


O.OOOe+000 


O.OOOe+000 
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